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1.  ORIENTATION 


The  present  document  is  the  interim  semi-annual  report  for  the  Bio- 
cybernetic  Control  in  Man-Machine  Interaction  project  at  UCLA  conducted 
under  Advanced  Research  Projects  Agency  Contract  No.  N00014-69-A-0200- 
4055.  The  project  started  in  April  1973  under  a different  contract. 

The  long-term  goals  were  described  in  detail  in  earlier  proposals  (UCLA- 
Eng-P2465-N-73  and  P-2719-C-74)  and  are  briefly  reviewed  below. 

The  ultimate  goal  of  the  project  is  to  implement  and  evaluate  the  incor- 
poration of  electrophysiological  brain  signals  in  selected  man-machine 
communication  procedures.  The  messages  considered  deal  with  perceptual, 
cognitive  or  affective  aspects  of  the  dialogues. 

In  conventional  man-machine  interaction  with  computer  terminals  the 
terminal  provides  most  of  the  external  environment  and  generates  in- 
puts of  stimuli  to  the  operator  in  the  form  of  graphic  displays  or 
alphanumeric  messages.  Typically  the  "response"  is  then  the  selection 
of  a keyboard  sequence.  This  motor  behavior  (i.e.  the  next  interactive 
step  in  the  interchange)  is  decided  upon  (voluntary  response)  from 
the  analysis  of  the  situation.  A closer  couplinq  would  be  obtained, 
however,  if  one  could  tap  the  covert  as  well  as  the  overt  responses 
and,  to  some  extent,  bypass  the  requirement  for  an  explicit  notor  out- 
put. Such  generalized  responses  can  be  categorized  as  follows: 

a)  Sensory  (Input-Exteroceptive) 

b)  Perceptual /Emotional /Cognitive  (Processing- Interoceptive) 

c)  Motor  (Output-Proprioceptive) 


A closely  coupled  man-machine  interface  can  be  conceived  as  an  inter- 
face t.iat  accesses  some  of  these  behavior  components  directly  from 
biosiinals  measured  on  the  body.  This  can  in  principle  be  obtained 
either  by  passively  monitoring  peripheral  signals  (respondents)  such 
as  eleccromyoqrams  (EMG)  or  electroencephalograms  (EEG)  and/or  by 
opening  new  (operant)  channels  by  conditioning  some  of  those  signals 
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In  a way  that  would  provide  reliable  computer  access  to  these  internal 
processes.  Close  couplinq  could  also  be  obtained  with  subliminal  muscle  C. 

control  or  very  low  overhead  motor  behavior  such  as  eye  movement  or 
blinks.  Whenever  applicable  this  would  in  fact  bypass  or  considerably 
reduce  motor  output  and  the  considerable  overhead  attached  to  the  extern- 
al izatlon.  To  that  effect  appropriate  respondents  must  be  found  and  v 1 

subsequently  reinforced,  stabilized  and  placed  under  voluntary  control 
by  operant  conditioning.  Electrophysiological  signals  as  found  in  the 
EEG  appear  to  be  the  only  candidate  offering  adequate  bandwidth  for  the 
additional  communication  channels.  The  present  project  uses  the  EEG  in 
this  manner  and  concentrates  on  event-bound  EEG  epochs,  i.e.  evoked  re- 
sponses. 

The  experimental  approach  consists  of  identifying  features  in  the  EEG  0 

(evoked  responses)  that  constitute  potential  codes  for  the  direct  com- 
munication of  specific  "messages"  relevant  to  Interactive  man-computer 
communication.  Such  messages  would  be,  for  example,  recognition  of  a 
clue  (matchinq),  Its  acceptance  or  rejection,  the  choice  between  (visual) 
alternatives,  the  neural  control  over  the  positioning  of  a pointer  on 
a screen,  etc. 

Electroencephalographlc  signals  collected  on  the  scalp  are  spatio-tem- 
poral events.  Because  of  electrodes  and  anatomical  limitations  space 
sampling  Is  often  coarse  and  time  assumes  the  role  of  principal  inde- 
pendent variable.  Time  functions  are  collected  on  each  location  or 
channel . 

To  decode  the  signals  one  must  evaluate  the  range  and  bandwidth  (i.e. 
the  time  windows  occupied  by  each  meaningful  feature  in  the  functions 
that  constitute  the  EEG  "signatures")  and  determine  the  rules  of  asso- 
ciation of  those  features  or  (in  linguistic  terms)  the  "syntax".  The 
relationship  that  these  (accessible)  brain  signals  offer  to  conscious 
experience  and  human  performance  (their  semantic  domain)  must  also  be 
Investigated. 
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The  starting  point  of  this  study  was  the  view  that  EE6  signals  are  a 
complex  structure  of  elementary  wavelets  that  reflect  individual  and 
sequential  events  takinq  place  in  various  brain  structures.  Because 
of  the  enormous  complexity  and  interlinkinq  of  these  events,  all  small 
fluctuations  in  the  EEG  have  generally  been  ignored  and  lumped  with 
instrumentation  noise,  while  all  the  attention  was  concentrated  on 
rhythmic  activity  or  (in  the  case  of  evoked  response)  slow  components 
of  relatively  large  amplitude.  Yet  it  is  becominq  evident  that  these 
sequences  and  patterns  of  distinct  wavelets  are  time  signatures  that 
constitute  observable  components  of  the  brain  "state  vector".  Sequen- 
tial rules  for  the  appearance  and  configuration  of  the  wavelets  may 
become  identified  as  the  syntactic  constraint  of  a neuro-electric  langu- 
age with  ?.  considerable  potential  in  man-machine  communication. 
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2.  PROGRESS  TO  DATE 


As  indicated  earlier,  the  UCLA  Biocybernetic  Control  in  Man-Machine 
Interaction  project  has  been  underway  at  the  Brain  Computer  Interface 
Laboratory  ( BCI > since  July  1973  under  ARPA  sponsorship.  Accomplish- 
ments to  date  for  the  ensemble  of  the  project  rouohly  fall  into  three 
categories,  namely: 

a)  evoked  response  experiment  results  (2.1) 

b)  development  of  the  computer  system  supporting  the  effort  (2.2) 

c)  development  of  computer  methodology  and  application  software 
for  real-time  EEG  identification  (2.3) 

The  accomplishments  during  the  first  year  have  been  described  in  more 
detail  in  the  Final  Technical  Report  1973-74.  The  present  document 
covers  the  first  half  of  the  second  year  (1974-75).  The  salient  items 
are  listed  in  the  present  section. 

2 . 1 Evoked  Response  Experiment  Results 

With  the  advent  of  the  second  year  the  experimental  program  went  into 
high  gear.  Some  initial  delays  were  due  to  system  development  because 
of  the  installation  of  a new  SDS  930  system.  A new  pool  of  subjects  was 
formed  and  an  extensive  screening  program  undertaken.  At  present,  five 
subjects  with  exceptional  performance  have  been  retained.  Discrimination 
accuracy  on  the  standard  four  color  (red/green/blue/yellow)  experiment 
used  In  the  screening  revealed  capability  for  accuracies  exceeding  90% 
of  correct  response  in  completely  randomized  testing  sets  of  trials  over 
a single  channel.  Multi-channe'  discrimination  reached  95%  and  even  99% 
in  the  best  cases  in  repeated  trials  after  new  techniques  for  elimination 
of  outlying  responses  were  introduced. 

Preliminary  experiments  have  also  been  completed  with  pattern  position 
that  have  definitely  established  the  feasibility  of  the  closed  loop 
"visual  light  pen"  experiment  described  in  the  next  section.  Discrim- 
inability  on  pattern  position  still  falls  short  of  that  of  color  at  this 
time.  In  these  experiments,  however,  no  attempt  had  yet  been  made  to 
optimize  the  targets  or  the  procedures. 
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2.2  Computer  System  Hardware  Improvements 

The  major  event  in  the  laboratory  system  occurred  at  the  beqinninq  of 
the  second  year  and  was  the  procurement  throuqh  DARO  and  the  installa- 
tion in  the  laboratory  of  a SDS  930  computer.  This  system  came  with  a 
complete  set  of  peripherals  includinq  two  tape  drives,  a card  reader  and 
a hiqh  speed  lineprinter.  Its  16K  of  memory  coupled  with  a high  speed 
drum  holdinq  two  million  characters  is  capable  of  qreatly  improved  per- 
formance for  on-line  data  acquisition  and  discrimination  and  in  addition, 
of  handlinq  a considerable  batch  processinq  load.  Since  the  labor  ory 
computer  was  a completely  compatible  SDS  920,  a reconfiquration 
made  that  turned  the  real-time  control  of  experiments  over  to  the  930 
and  relegated  the  920  to  the  function  of  I/O  processor.  A special 
operatinq  system  was  developed  to  interleave  on-line  and  off-line  work. 
Between  experiments  the  batch  capability  is  used  for  computinq  decision 
rules  on  trainina  sets  and  performing  various  data  reconfigurations.  All 
useful  laboratory  application  routines  were  re-written  for  the  system  and 
new  ones  introduced.  In  particular  a BCI  version  of  the  Stepwise  Dis- 
criminant Analysis,  the  orthoqonal ization  procedure  and  a factor  analysis 
program  were  written  and  completely  debuqqea  by  January  1975. 

2 . 3 Computer  Methodology  and  Software  Development 

Several  substantial  improvements  were  obtained  in  the  evoked  response 
discrimination  procedure.  One  side  of  the  investigation  dealt  with 
determining  the  threshold  for  posterior  probabilities  to  be  chosen  for 
creatinq  the  extra  class  of  "don't  know"  responses.  Increasing  the 
threshold  increased  the  reliability  of  correct  responses  but  also  in- 
creased the  number  of  instances  in  which  the  computer  declined  to  classify. 
This  optimal  tradeoff  for  a qiven  cost  function  can  be  found  from  the 
curves  relatinq  the  correctness  of  classification  versus  "don't  know" 
frequency  plotted  throuqh  multiple  trials.  A similar  inquiry  was  done 
to  find  the  influence  of  the  "elimination  of  outliers"  from  the  traininq 
set.  Outliers  are  responses  that  in  the  traininq  set  fall  substantially 
outside  the  rest  of  the  cluster.  The  procedure  eliminated  such  responses 
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and  recalculated  the  decision  rule.  Aqain  the  threshold  for  outlier 
label inq  can  be  varied  and  an  optimum  found,  usinq  testinq  set  correct- 
ness as  criterion. 

The  informational  meaninq  of  the  decision  rule  qiven  by  the  discriminant 
procedure  was  analysed  theoretically  and  a mutual  information  measure  was 
defined  and  added  to  the  output  of  the  procedure.  This  measure  provides 
an  objective  and  readily  understood  scale  to  compare  within  paradiqms, 
experiments  or  subjects. 

In  prevision  of  coqnitive  experiments  requirmq  more  complex  visual  tar- 
qets  for  subject  stimulation,  an  all  out  effort  was  launched  to  improve 
the  qeneration  of  qraphic  displays  on  the  laboratory  I ML AC  qraphic  system. 
To  that  effect,  a new  compiler  lanquaoe  ,GRAL)  was  developed  and  docu- 
mented. GRAL  allows  specification  of  animation  imaqes  to  be  made  in  very 
simple  statements.  Compillnq  is  done  on  the  360/91  to  produce  object 
codes  for  the  IMLAC  which  can  be  transferred  from  CCN  to  the  laboratory 
usinq  the  existinq  link.  At  the  same  time  a special  proqram  for  the  qen- 
eration of  human  faces  was  written  and  successfully  debuqaed  in  IMLAC 
assembly  lanquaqe  as  GRAL  was  not  available  at  the  timp.  This  proqram, 
developed  under  a different  (Air  Force)  contract,  will  directly  support 
the  present  work.  At  this  time  facial  features  are  placed  under  key- 
board control.  Relatively  simple  modifications  are  beinq  introduced 
that  will  Diace  the  control  under  the  main  laboratory  computer.  Facial 
expression  can  then  be  used  as  feedback  stimuli  in  the  biocybernetics  loop. 
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!•-  EVOKED  RESPONSES  RESULTS  SUMMAR I E S 


3. 1 Color  Experiments 
Purpose 

1)  To  develop  further  the  methodoloqy  and  performance  of  on-line 
machine  decodinq  of  brief  electrical  siqnals  evoked  on  the  human 
scalp  by  sensory  events. 

2)  To  evaluate  a qroup  of  subjects  in  order  to  choose  for  further 
study  those  who  show  adequate  performance. 

Methods 

Subjects  are  fifteen  untrained  female  students  (aqes  19-24).  Each  was 

qiven  a routine  Ishahara  test  of  color  discrimination.  Individual  record- 

1 nq  sessions  were  then  conducted  as  described  below.  Each  required  about 
two  hours. 

Standard  silver  disc  electrodes  are  applied  with  electroconductive  paste 
at  five  locations  on  the  scalp  (Fpz,  Pz,  Oz,  Oj  and  0?)  and  to  the  ear- 
lobes (Aj-A2).  Electrode  impedance  was  always  less  than  10, 000 n.  Four 
EEG  data  channels  are  recorded  (Ch  1:  Pz-A,  Ch  2:  Oz-Pz,  Ch  3:  0 -Pz, 

Ch  4:  02-Pz).  The  Fpz-Oz  siqnal  is  used  as  a blink  artifact  detection 
channel;  If  a peak-to-peak  deflection  occurs  which  exceeds  a preset  level, 
the  current  epoch  is  aborted  in  order  to  avoid  takinq  data  corrupted  by 
electro-oculoqraphic  activity  while  the  subject  has  her  eyes  movinq  or 
even  durlnq  brief  moments  of  eye  closure.  EEG  siqnals  are  amplified  over 
a bandwidth  of  1.0  to  70  Hz,  and  diqitized  every  four  msec.  A data  epoch 
consists  of  samples  taken  both  before  (400  to  960  msec  dependinq  on 
Individual  runs)  and  after  the  stimulus  time  (320  msec  in  all  instances). 
The  data  taken  prior  to  stimulation  is  necessary  to  provide  a lead  time 
whenever  the  orthogonal izatlon  routine  of  Glassman  is  used  in  subsequent 
processing.  It  is  otherwise  dropped  at  analysis  time. 

Stimuli  consist  of  brief  (30/Wsec.)  flashes  of  xenon  strobe  light  ( 107 
lux  illuminance  in  collimated  beam)  projected  through  one  of  four  randomly 
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selected  interference  filters  with  peak  transmission  wavelenqths  of 
620nm  (Red),  575nm  (Yellow),  515nm  (Green)  and  465nm  (Blue)  and  a yellow 
(Wratten  H)  background  light  with  a luminance  of  100  NITS  or  10  1am- 
berts.  The  stimuli  are  viewed  either  throuqh  diffusinq  qoqqles  worn  by 
the  subject  or  by  a large  diffusing  screen  of  translucent  plastic  placed 
before  the  subject.  All  experiments  are  conducted  inside  a sound  attenu- 
ated, electrostatically  and  radio  frequency  shielded  room.  Two-hundred 
epochs  are  taken  and  recorded  on  digital  tape. 

Analysis 

Data  analysis  is  performed  on  a SDS  930  computer.  Stepwise  linear  dis- 
criminant analysis  (SDA)  is  used  to  develop  four  linear  discriminant 
functions  (one  for  each  of  the  four  color  classes)  which  are  then  eval- 
uated for  each  epoch  in  order  to  determine  the  a-posteriori  probability 
of  belonging  to  each  group.  The  processing  is,  therefore,  conducted  in 
the  laboratory  on  a dedicated  machine  in  contrast  to  previous  work  in 
which  stepwise  discriminant  analysis  was  performed  usinq  the  BMD07M  pack- 
age running  in  batch  mode  on  the  IBM  360/91  at  the  Campus  Computing  Net- 
work. 

The  requirements  for  on-line  processing  necessitated  either  a modifica- 
tion of  07M  so  that  it  could  be  linked  with  the  Monitor/Line  handler 
routine  which  interfaces  the  BCI  laboratory  computers  to  the  360/91,  or 
the  development  of  a customized  version  which  could  run  in  our  SDS  930 
computer  in  the  BCI  lab.  The  latter  route  was  chosen,  and  the  in-house 
SDA  program  now  possesses  several  features  not  provided  by  the  standard 
BMD  packaqe.  These  features  include: 

1)  The  capability  of  selecting  and  labeling  any  40  variables  from 
the  multi-channel  EEG  data  input  produced  by  the  Data  Handling 
Supervisor/Scheduler  running  on  the  930, 

2)  Flexibility  in  the  assignment  of  some  epochs  to  a training  set, 
and  other  epochs  to  a testing  set, 

3)  Capability  to  read  the  group  type  of  each  epoch  from  the  epoch 
headers  provided  as  part  of  the  BCI  Data  Format, 
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4)  The  ability  to  skip  pre-stimulus  data  automatically; 

5)  Implementation  of  an  a-posteriori  decision  threshold  parameter 
so  that  epochs  which  do  not  produce  a probability  or  belonqinq 
to  any  source  qroup  with  a value  hiqher  than  the  decision  thres- 
hold are  classified  into  a new  "default"  cateqory; 

6)  An  outlier  rejection  routine  which  controls  the  acceptance  of 
epochs  for  iterative  qensration  of  the  discriminant  functions. 

For  example,  only  those  epochs  would  be  entered  which  on  a prior 
SDA  run  have  been  correctly  classified,  or  epochs  which  have  been 
defaulted  (but  not  misclassified)  as  well  as  those  correctly 
classified. 

The  SDA  proqram  also  routinely  produces  averaqes,  F ratios  for  each  var- 
iable, covariances,  correlation  coefficients,  results  at  each  step,  eval- 
uation of  the  discriminant  functions  (DF's)  and  epoch  predictions,  if 
requested  on  control  cards.  In  the  last  version  the  calculation  of  the 
mutual  information  measure  is  included. 

Results 


For  the  initial  evaluations,  a qeneral  data  window  was  adopted  which 
selected  10  variables  from  each  of  four  EEG  channels,  beqinninq  at  80 
nsec  latency  from  the  stimulus,  and  takinq  every  fourth  variable  (16  msec 
intervals)  to  224  msec  latency.  SDA  was  oiven  on  F-to-enter  and  F-to- 
delete  of  2.2,  a decision  threshold  of  0.25  (no  defaults),  and  told  to 
qo  10  steps,  F level  permittinq.  Usually  100  epochs  were  taken  as  a 
traininq  set,  with  an  inter  epoch  steppinq  interval  of  2,  that  is,  every 
other  epoch  of  a qiven  qroup  type  (source  color)  was  taken  to  train  the 
discriminant  function.  The  testing  set  then  consisted  of  the  other  100 
epochs,  25  from  each  qroup.  Two  confusion  matrices  are  obtained  upon 
evaluation  of  the  single  epoch  events  by  the  DF;  one  for  the  training  set, 
and  one  for  the  testing  set.  Overall  performance  is  defined  as  percent- 
age of  correct  classification  on  the  testinq  set.  The  following  results 
were  obtained: 
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Subject-Date 

Experiment  Type 

% Correct 

(6=goggles,  S=screen) 

SB01 

MR1 3 

G 

87 

SB01 

MR1 3 

S 

86 

APN1 

MR1 9 

S 

69 

ALL! 

MR25 

G 

76 

ALL1 

MR25 

S 

68 

SA61 

MR27 

G 

82 

SA61 

MR27 

S 

84 

SADI 

AP03 

G 

81 

NLM1 

AP08 

G 

84 

JMS1 

API  0 

G 

68 

S0S1 

API  5 

G 

87 

MMD1 

API  5 

G 

71 

ATW1 

API  7 

G 

74 

Data  from  three  subjects  is  not  included  due  to  hardware  problems  which 
prevented  accurate  data  collection.  One  additional  subject's  data  was 
formatted  incorrectly;  this  error  is  expected  to  be  reversible.  The 
average  performance  of  all  ten  subjects  was  78%,  using  a very  general 
san-^le  variable  selection  paradigm.  Five  of  them  showed  performance 
ranging  from  81  to  87%  and  these  will  be  retained  for  further  study, 
he  variables  chosen,  their  F levels,  the  discriminant  functions,  and 
the  training  and  testing  confusion  matrices  for  these  five  subjects  are 
displayed  in  Tables  1-5. 

The  data  froi,  subjectSBOl , whose  performance  using  the  general  16  msec 

window  was  87%,  was  analyzed  more  extensively  in  order  to  investigate 
the  following  areas: 

1)  The  degree  of  performance  to  be  obtained  by  choosing  the  best 
ten  variables  from  160  of  320  samples  taken,  rather  than  enter- 
ing only  40  samples; 
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ai  ru  (vi  oj 


3.0/  87.0 


SH01  MR1 3-75-0  FOUR  COLOR  VER  EXPERIMENT,  GENERAL  16  MSEC.  WINDOW 
DlSCRlMlf.ANT  FUNCTIONS  AFTER  10  STEPS,  WITH  D.O.F.  « 

epochs  accepted  unconditionally. 


VARIABLE 

F 

GROUP  NAMES 

i .0 

EX  N A 

LEVEL 

RED-8 

YELLOW-6 

GREEN-3 

blle-i 

1 

1 / 080 

• 1 6939E 

02 

-.69074E-01 

- • 77538E-02 

-.21360E-01 

-•222C9E-01 

k 

1/  128 

. 1 8892E 

02 

•76035E-01 

• 16087E-01 

.58293E-02 

• 58S99E-02 

5 

1/144 

.70889F 

01 

•4717RE-01 

•20427E-01 

. 24993E-01 

.486C5E-02 

11 

2/083 

• 1 2256E 

C2 

-•61796E-01 

- • 59554E-03 

- . 1 7758E-01 

-•183C3E-01 

15 

2/144 

•83504F 

01 

•65404E-01 

•26500E-02 

. 222C9E-01 

•991^ 8 E- 02 

21 

3/033 

.52857F 

02 

•86481E-01 

•30784E-02 

.19380E-01 

•28339E-01 

24 

3*123 

.23376E 

02 

-• 1079CE-01 

-.19784E-01 

o20024E-01 

.25626E-01 

25 

3/144 

. 16007E 

02 

-•21824E-01 

•31948E-03 

- . 31 637E-01 

. 1C857E-01 

26 

3/160 

• 1 2754E 

02 

-.  16766F-01 

• 17582E-01 

- . 10067E-02 

-.2695AE-01 

?8 

3/  192 

.62894F 

01 

- • 804^0E“02 

-•17815E-03 

-.52971E-02 

-.25828E-01 

CONSTANT 

- • 43591F  02 

-.51934E  31' 

- . 65809E  01 

-•913S8E  01 

TRAINING 

CONFUSION 

matrix 

1EPA  = 1 

NEPI  = 100 

. - -■  ■ — 

source: 

PERCENT 

classified 

AS 

correct 

RED-8 

YELLOW-6 

GREEN-3 

BLUE-1 

DEFAULT 

RED-8 

loo.c 

25.0 

.0 

.0 

.0 

.0 

YELLO.v-6 

. 96*0 

• C 

24.0 

1*0 

• 0 

.0 

GREEN-3 

92.0 

.0 

1.0 

23.0 

1.0 

.0 

blue-i 

TOTAL 

88.0 

94.0 

.0 

.0 

3.0 

22.0 

.0 

testing  confusion  MATRIX  IEPT  «=  2 NEPI  = 100 


source 

PERCENT 

CLASSIFIED 

AS 

’ * ‘ 

CORRECT 

RED-8 

YELLOW-6 

GREEN-3 

BLUE-1 

CEFAULT 

RED-8 

loo.o 

25.0 

.0 

.0 

.0 

.0 

YELLOW-6 

80.0 

.0 

20.0 

5.0 

• 0 

.0 

GREEN-3 

88.0 

.0 

2.0 

22.0 

1.0 

.0 

J3LUZ-1 

80. 0_ 

..  .*0 

1.0 

4.0 

20.0 

.0 

TOTAL 

87.0" 

completed  10 

STEPS  OF 

ANALYSIS 

— " — 

/ 

- - 

— ... 

TABLE  1 
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SADI  VISUAL  EVOKED  RESPONSE  EXPERIMENT  An.  DATE  APR  23  .M.BUCK 
DATA  SET~  IDENTIFIERS:  EXPR  - OC-Hl  SUBJ  * SADI  DATE  = AP03 


NO.  OF  VARIABLES  * 

40 

WGT • D.O.F. 

= :oc. co 

F LEVEL  TO 

REMOVE  ■ 2 

.200 

POSTERIORI  THRESHOLD  = .250 

D I SCR  I M I NAN  T FUNCTIONS  AFTER 

10  STEPS,  WITH 

D.O*F.  - 

3.0.  87.0 

EPOCHS  ACCEPTED  UNCOND I T I ONALLV 

• 

VARIABLE 

F 

GROUP  NAMES 

INDl 

X NAME 

.level 

RED-8 

YELLOW-6 

GREEN-3 

blle-i 

3 

1#  1 12 

.60713E  01 

.19237E-01 

• 14228E-01 

.31393E-02 

.1895CE-01 

4 

1*  123 

• 80609E  01 

. 171*.2E-01 

. 16852E-01  - 

.77749E-02 

'•  • 8533?E-02 

5 

144 

•15001E  02 

-.39176E-02 

■ • 26977E-01 

. 12534E-01 

-.309C7E-02 

13 

2.112 

.76047E  01 

. 17507E-01 

• 2C835E-01  - 

.14725E-04 

• 17553E-01 

15 

2*144 

• 1 303UE  02 

.43793E-01 

• 7839  IE-02  - 

. 17240E-02 

- » 121 ^ lE-Ol 

16 

2.160 

< 1 A830E.  02 

.65495E-02 

-.19705E-01 

•21624E-01 

•499B5E-02 

20 

2*224 

• 1 4791E  02 

-.31194E-01 

-.35081E-02  - 

.13316E-01 

- » 1 962  7E-02 

28 

3.192 

• 5 1069E  01 

.58222E-02 

■ . 77483E-02  - 

.71632E-02 

-.12741E-01 

.15 

A.  144 

.6  =13E  01 

-.10735E-01 

-» 10740E-01 

.B9864E-02 

• 768  8 3E-0p 

36 

4*  1 60 

.91/89E  01 

-.1135CE-01 

• 545 1 8E-02  - 

.21538E-01 

-. 1C932E-01 

CONSTANT 

-.13625 

- • 64923E  01  - 

.51043E  01 

-.47631E  01 

training 

CONFUSION 

matrix 

IEPA  * 1 NEPI  = 100 

. - .... 

source 

PERCENT 

CORRECT 

RED-8 

CLASSIFIED  AS 
YELLOW-6  GREEN-3 

BLUE-1 

DEFAULT 

RED-3 

92.0 

23.0 

1.0  .0 

1.0 

.0 

ELLOWr.6 

96.0 

.0.  _ 

24*0  *0 

1.0 

.0 

GREEN-3 

8C.0 

.0 

1.0  20.0 

4.0 

.0 

BLUE-1 

_ 88.0 

.0 

1.0  2.0  . 

22.0 

.0 

TOTAL 

89.0 

TESTING  C9NEUSI0N  MATRIX  IEPt  = 2 NEPI  = 100 


SeURcE 

PERCENT 

CLASSIFIED 

AS 

CORRECT 

RED-8 

YELl.BW-6 

GREEN-3 

BLUE-1 

DEFAULT 

RED-3 

92.0 

23.0 

1.0 

.0 

1.0 

.0 

YELLOW-6 

72.0 

.0 

18.0 

2.0 

5.0 

.0 

GREEN-p 

80.0 

1.0 

.0 

20.0 

4.0 

.0 

blue-i._ 

80.0 

1 ._0  _ 

1.0 

3.0 

2_0  • 0 

.0 

TOTAL 

81.0 

COMPLETED  10  STEPS  OF  ANALYSIS 


Reproduced  from 
best  available  copy. 

NL»11-Af,OS-7r5-OiF0UR  C0L8R  VER  EXPERIMENT  FOUR  CHANNEL  WINDOW 
DATA  SET-  IDENTIFIERS;  EXPR  «=  0C42  “sudT^'TlmT  DAtT“7pG{T 


:Jj.  £ F V^RIAFLFS  ■ 40 UGT.  Q ♦ 6 ♦ F « = 1CQ.C  C 

il_UVfl^_j8  REMflVE  _■ 2.200 POSTERIORI  THRES HOLD  = .350 

OfSCfllMlNAVT  FUNCTIONS  AFTF9  10  STEPS/  WITH  D • P • F . = 3,3,  g7 

EPOCHS  ACCEPTED  UNC0 VD l T 1 SMALL vT~ 


VARlAfiU' 


1 / 080 

.-3MAE  01 

• 1 Aci50F-31 

Lilt 

01 

.-.34  4 9 3£  -QL 

1/00 

. 9 90  7 2 E ri 

• 235C7F-01 

..?6?_3R£_CU_ 

-♦50460F-Q? 

2/OSO 

.'OtSlE  G2 

-•2741PF-01 

Constant 


- • 

131 

2 

c 

r«' 

GRP  UP  NAP 


— «.l36S£J.a.T? _ 

" • 1 2531E-01  .205F9E-01  *1799^-01 

" • 7PQ7AF-Q2  » 1063CE-O1  .1354 a E - 0 1 


?E-0? 


633ESE-02 


1 1 1 7 SC  92  -.657C6E  01 


REDjiS 

YELLOW-^ 
S&EEN-J 
BLUE- 1 

_Tj3T^ 


C I'v'i  rCT 

92*0 

340 

8 *0 
900 


FPD-- 

2S..JL 


— -C  LA  SSJ-E-ICD..  ME 

vELLOW-6  GREEm-3  BLUE-1 

— .*.0 o 1.9 

23*0  2.0  .0 


.0 

‘ 2 

.0 

22 

default 

tSL. 

• 0 


C8  .FUSION  MATRIX 


SOURCE  PERCENT 

- CORRECT 


•JEPl  = 100 


classified  as 

-TELLQW^A,  r,REtN-3  BLUE-!  PFFAti.T 


COMPLETED  10  STEPS  OF  ANALYSIS 


TABLE  3 


1 


SAG1  VISUAL  EV0KLD  RESPONSE  EXP.  SDA  RUN  DATE  AP23 

DATA  SET  I DE N T I F I E RSV  E XPR  ■ OCH S SUB J irtfST  DATE  - MR27 


A8.JL_80AR.IABLES_j»__  _40_ 

F LEVEL.  10.  REM0VE  » 2»200 


WGT » D • 0 * F . c 

_P0STERI3RI  THRESHOLD 


100.00 

.250 


DlSCRlMjMAf.f  FUNCTIONS  AFTER  10  STEPS,  WITH  D.0.F.  = 

epochs  accepted  unconditionally. 


variable 

INDEX 
7 

12 
lb 
19 
22 
23 
25 
29 
33 
38 


training 
source 


NAME 

level 

1/176 

• 86103E 

01 

2/096 

. 16460E 

02 

2/144 

• 2501 4f 

02 

2/208 

• 43662E 

Cl 

3/096 

.55176E 

01 

3/112 

.78645E 

01_ 

3/144 

. 1 4439E 

02 

3/208 

.14817E 

02 

4/112 

.18691E 

02 

4/192 

.23540E 

02 

RED-8 

*•  28001 E-02 
-«  H10AE-01 
* 26654E-01 
* 12186E-01 
•68966E-02 
•A7H3E-02 
••  19096E-01 
•73393E-02 
•27685E-01 
•15A37E-01 
••82761E  01 


GROUP  NAMES 
YELLOW-6 
-•14366E-01  ■ 

•15151E-01 
•35758E-01  . 

. 19270E-02 
- • 55048E-03 

.35094E-02 

’ . 95040E-03 
■ • 1 4690E-0 1 
'.95332E-02  - 

• 19838E-01 
' • 52343E  01  - 


GREEN-3 
■ • 1 1239E-01 
• 1 4627E-03 
.20884E-01 
• 12330E-01 
. 18980E-02 
• 78951E-03 
•24049E-01 
•25219E-01 
.34436E-02 
•15139E-01 
•A7336E  01 


CONFUSION  MATRIX  IEPA 


1 


KEPI  = 100 


RED-8 

YELLSW.-6 

GREEN-3 

blue-i 

TOTAL 


PERCENT 
CORRECT 
92.0 
92*  0_ 

92.0 

100.0 

94.0 


RED-8 

CLASSIFIED 

YELL0W-6 

AS 

GREEN-3 

BLUE- 

23.0 

1.0 

.0 

1.0 

1.0. 

23.0 

1.0 

.0 

.0 

.0 

23.0 

2.0 

.0 

.0 

.0 

25.0 

DEFAULT 

.0 

.0 

.0 

.0 


TESTING  CONFUSION  MATRIX  IePT 


NEPI  = 100 


source 

percent 

CORRFCT 

RED-8 

Class i f h 

YELLOW-6 

RED-8 

80.0 

20.0 

3.0 

YELL0W-6 

84.0 

.0 

21.0 

GPEEN-3 

84.0 

.0 

3.0 

BLUE-1 

TOTAL 

88*0 

84.0 

1.0 

2.0 

3 AS 
GREEN-3 

.0 

3.0 

21.0 

.0 


BLUE-1 

2.0 

1*0 

1.0 

22.0 


DEFAULT 

.0 
• 0 
• 0 
.0 


3*3/  87.0 


. _ PLUE-1 

• 11127E-01 
» 16C67E-02 

•• 12518E-01 
•33797E-02 
•523A0E-02 
_•  l"7A6Ej-0l 

* 97532E-02 
•3C-97E-01 
•33-32E-01 
.289'' IE -01 
.55678E  01 


COMPLETED  10  STEPS  OF  ANALYSIS 


TABLE  4 
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S0S1-AP15-75-0,  0C41  F0UR  COLOR  VER(  4 CHANNELS,  16  MS.  WINDOWS") 

j DATA  SET  IDENTIFIERS!  EXPR'T^c^t '~"SUBJ“« S0S1  “DATE  ~=  AP15 

* _ ___  _ 

• NB»  OF  VARIABLES  « 40 WGT » Q.0. F.  « 1 ; 0 . 00 

l LJ.EVEL  TO  REMOVE  * 2*200 POSTERIORI  THRESHOLD  = .250 

DISCRIMINANT  FUNCTIONS  AFTER  10  STEPS,  WITH  D.B.F.  * 3.0,  87.0 


EPOCHS  ACCEPTED  UNCONDITIONALLY. 


P GROUP  NAMES 

L EVE  L RE  Dj;  8 YE  L L gW  - 6 GREEN-3 B U E - 1 

.93797E  01  -• 44250E-01  .34164E-02  -.10619E-01  -»96752E-02 

*.UZi»9E_02 .539Z2E-01 ._16460E-01 .25348E-01  .39:522-02 

.73737E  01  -.20241E-01  -.87971E-02  -.53085E-02  T10311E-01 

.11015E  03  .24794E  00  -.48541E-01  -.86770E-01  -.8C-91E-01 

.17946E  02  .55192E-01  .37621E-01  .lM56E-0‘i  T66*HE-02 

•12 275 E_0 2 3789 2Ej^02 z* 2 2 3 6 5 E -01  - . 3 1 8 8 OE  - 0 1 • 3 £ : 6 1 E - 0 1 

• 15400E  02  .86881E-01  .49278E-01  .7844~7E-0l  .22558E-Oi~ 

• 21960E_02 *9753  IE -01 ._15499E^01_  .30664E-01  .28'26E-0l 

.26837E  02  -.14136E-01  -.51733E-02  .31911E-01  ^.24505E.01 

.J 0844 E.  02 -.26383E-01  -.17669E-01  -.44846E-01  -.6H55E-02 

- • 32239E  02  *.59442E  01  *.96742E  01 

T R aTn Fng"  CO NFUSIO N M AT  R IX  IEPA  • 1 NE>TT  100 


21 

23 

24 


VARIABLE 
NAME 

1/080 
1, 192  _ 
1/208 
2/080 
2,096 
2/  1 12_ 
2/128 
3/ 08 0_ 
3,112 
3/128  _ 
CONSTANT 


c 


oi 


2)  Near  optimal  trade-off  on  the  number  of  stens  that  the  SDA  pro- 
qram  should  be  allowed  to  run  for  the  most  efficient  performance; 

3)  A near  optimal  trade-off  on  the  value  of  too  hiqh  a threshold 
causes  most  of  the  epochs  to  be  defaulted,  while  a low  value 
fo»"ces  some  misclassifications  where  only  default  would  be 
recorded; 

4)  The  level  of  performance  when  the  traininq  set  is  taken  from  the 
first  half  of  the  data  set,  and  the  testing  set  from  the  second 
half; 

5)  The  statistical  significance  of  the  obtained  classification  per- 
formance. 

In  order  to  select  a better  subset  of  variables  to  be  used  by  SDA,  four 
passes  of  the  program  are  performed,  taking  every  other  variable  from  the 
80  samples  which  are  available  from  each  EEG  channel.  Ten  steps  are 
allowed,  thus  the  ten  best  samples  of  the  40  entered  from  each  channel 
are  obtained.  These  40  selected  variables  from  all  four  EEG  channels  are 
then  entered  into  a final  SDA  run,  and  the  results  are  obtained  for  each 
step,  from  0 to  20. 

Initially,  step  0,  the  average  value  of  each  variable  chc sen  Is  obtaineJ 
(Table  6).  Next  (Table  7)  is  obtained  the  F level  of  the  variables  avail- 
able to  this  execution.  At  step  0,  these  F levels  are  related  to  the 
probability  p(that  the  relative  variances  measured  could  be  obtained  by 
chance)  with  dearees  of  freedom  as  shown.  A p <.01  is  obtained  with  a 
F of  approximately  4.  A p <.001  corresponds  to  F=6.  Twenty-six  vari- 
ables exceed  F=6,  and  variable  22  (channel  3,  80  msec)  has  an  F of  125. 

The  value  of  F-to-enter  is,  nevertheless,  set  at  2.2  in  order  to  give  more 
variables  a chance  to  be  selected.  No  defaults  are  allowed.  On  step  One, 
the  program  selects  the  variable  with  the  highest  F value  (22),  and  cal- 
culates a set  of  discriminant  functions.  These  are  listed  in  Table  8. 

A chi  square  value  of  40.48  is  obtained  for  twenty-one  reds  from  the  test 
set  correctly  classified,  where  5.75  would  have  occurred  by  chance.  This 
is  significant  beyond  the  p=.001  level,  as  is  the  eighteen  yellows  out  of 


S-'u'l  4 CPL5P  V£p  EX°R.  $DA  RUN  AP  ?4  H RUCK 

AVERAGE  VALUE  OF  VARIA5LES 


VARIABLE  GRAND 

INCEX  NAME  AVERAGE 

1 1*032  .52703E  02 

1*056  -, 1220BE  02 

1*072  -.<153122  02 

A 1*104  -.17565E  02 

5 1*120  “ • 1 1 77 1 E 01 

6 1*123.  ..67958E  02 

7 1*136  . 1 3040E  03 

3 1*160  .L9C45E  03 

1*208  . 1 1?03E  03 

10  1*272  .21729E  02 

11  2*072  . 10155E  03 

12  2*080  . 1125SE  03 

13  2*083  .4594SE  02 

14  2*104  - . 26333E  02 

15  2*120  -.10458E  02 

16  2*152  • . 7 4 0 8 E 02 

17  2*168  -.10984E  03 

18  2*  20 3 - • 11 269E  03 

19  2*224  * • 12694E  03 

20  2*230  _ -.75U5E  02 

21  3*043  .A9354E  02 

->  22  _ 3*030  _ .21355E  03 

23  3*088  . 16671 E 03 

24  3*_096 • 93 1J56E  02 

25  3*120  -.31500E  02 

26  3*128  . 4.5969E  02 

27  3*144  -,96229E'02 

28  3*160  • . 88885E  02 

29  3*200  - « 10223E  03 

30  3*312 • 10325E  03 

31  4*056  -.21219E  02~ 

32  4*064  -.22302E  02 

33  4*072  • 86656E  02 

34  4*080 _ .90635E  02 

35  4*096  - . 82667E  02 

36-„_<t*120  -.44302E  02 

4*123  * .56094 E 02 

38  4*136  -.98990E  OP 

39  4*144  -. 15218E  03  ■ 

40  4*272  -.85979E  02  ■ 


WI 

REO-8 
57235E  02 
582S6E  02 
282522  03 
19810E  02 
12762E  03 
22171E  03 
29332E  03 
2821CE  03 
63667E  02 
75714E  01  ■ 
27729E  03 
27452E  03 
11529E  03 
51571E  02  ■ 
11757E  03  ■ 
1559CE  03  ■ 
15176E  C3  ■ 
91095E  02  • 
10752E  03"- 
52095E  02  • 
35857E  02 
58852E  03 
30490E  03 
64000E_02 _ 
18600E  03"  • 
21748E  03  - 
22743E  03"  - 
1 1 8332E  03 
38286E  62  * 
11733E_03 
6S095E  01  - 
14524E  03  - 
30590E  03  - 
33838E  03  - 
10343E  03  - 
J.7595E  03  - 
19424E  03"  - 
2930CE  03  * 
27724E  03  - 
10305E  03  - 


thin  group 

YELL9W-6 
.41520E  02 
.96800E  01 
. 30630E  02 
.54000E  01 
.24440E  02 
. 67S40E  02 
.10252E  03 
• 90320E  02 
. 1 1780E  03 
-.24240E  02 
. 19880E  02 
• 71760E  02 
.86000E  01 
- . 76400E  01 
-.43200E  C2 
-.2M20E  02 
- . 1 0948E  03 
-.12740E  03 
-. 1 1732E  03 
-.43840E  02 
. 37040E  02 
. 45680E  02 
, 38720E  02 

• 88120E__02 

• 822R0E  02" 
_*  1 0948E  03 
.5 1360E  02 
.14720E  02 
t 1 1092E  03 
.82360E  02 
.5736‘OE  '62 
.84200E  02 
.28600E  02 
.17840E  02 
.138 ODE  63 
.10024E  03 

• 9192CE  0"2 
. 68600E  02 
. 76480E  "02 
. 1 4Q80E  02 


averages 

GREEN-3 
• 59920E  C2  . 

• 1 1080E  C2  -. 
•26520E  C2  -. 

- • 88840E  02  *, 
-•86800E  01  -. 

• 66000E  01  . 

.80040E  02  . 

• ?1 964E  03  . 

• 1 4456E  03  . 

.51200E  02  . 

• 61200E  02  . 

_ -90320E  02 
• 64320E  02  . 

• 17400E  02  -. 
•31880E  02  . 

-.81120E  02  -. 
-•91840E  02  -. 
-.10652E  03  -L 
- .12356E  C3  -. 
-.92920E  02  -. 
-S1440E  02  . 

• 1 6472E  03  . 

•23232E  C3  . 

_.21564E  03  . 

• 20880E  C2  V 

• 44760E  02 

11076E  03 

-.S6840E  02  *. 
- • 63200E~C2~- » : 

• 1 4564E  03  .( 

- • 34360E  02  • J 

-•87880E02 

* • 17560E  02  il 
• 62960E  02  .1 

.30400E:  02~TT: 
-.22240E  02  .1 

' •~lO160E~o2  Vl 
-.35960E  02  - .J 
-.  17828E  "o"3  *71 
* • 1 1 G64E  03  -.1 


TABLE  6 


i 

1 


* * 


STEPWISE  DISCRIMINANT  ANALYSIS  SB01  MRl 

RECURSI0N  = 3 DATA  SET 

Me*  ?f  data  = 96  . 

F LEVEL  T0  ENTER  =>  2.200 

F LEVEL  8F  VARIABLES,  D.Q.F.  = 3*0/  92.0 


f 


*1 


i 


» 

) 


) 


r 

V 


variable  f 


Index 

name 

LEVEL 

i 

1 * C32 

.208727 

2 

1,056 

2.437647 

3 

1,072 

60.091398 

1,104 

5.311652 

5 

1,120 

35.878864 

6 

1,128 

34.910474 

7 

1,136 

32.919548 

8 

1,160 

15.202145 

9 

1,208 

4.652525 

10 

1 ,27.2  . 

3.890392 

11 

2,072 

32.601210 

12 

2,080 

36.2714Q6 

13 

2,088 

9.052933 

14 

2,104 

5.458114 

15 

2,120 

30.072571 

_.16 

_2, 152 

. 11.926722. 

17 

2,168 

3.014460 

18 

2,208 

.846164 

19 

2,224 

2.300167 

20 

2,280 

2.808844 

21 

3,048  „ 

1 .043989 

22 

3,080 

125.667376 

23 

3,088 

33.140087 

24 

3,096 

21.931118 

25 

3,120 

57.440999 

26 

3,128 

58.281712 

27 

3,144 

29.102169 

28 

3,160 

20.508486 

29 

3,200 

16.5°3696 

30 

3,312 

3.667676 

31 

4,056 

1 .633334 

32 

4,064 

18.652152 

33 

4,072 

35.31 48^3 

34 

4,080 

41 .152863 

35 

4,096 

1 1 .395302 

36 

4,120 

33.814405 

37 

4,128 

24.171998 

38 

4,136 

28.734916 

39 

4,144 

13.110085 

40 

4,272 

6.076171 

TABLE  7 
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twenty-four.  Green  classification  fails  to  achieve  sianificant  accuracy, 
as  does  blue,  with  only  one  variable  selected. 


It  can  be  seen  how  the  DF  operates:  The  averaqe  value  of  variable  22 
is  laraer  for  red  than  for  any  other  color,  and  smallest  for  yellow. 

The  coefficient  for  the  red  DF  is  also  larger  than  the  coefficient  for 
any  other  qroup,  and  the  yellow  coefficient  is  the  smallest.  As  shown 
in  Se-tion  4,  the  coefficients  in  the  decision  rule  covary  with  the 
averaqe  values.  (They  would  coincide  if  the  variables  were  independent 
and  of  variance  One).  The  coefficients  are  used  to  calculate  the  a 
posteriori  probabilities  of  belonqinq  to  each  qroup  for  each  epoch 
tested.  The  decision  qoes  to  the  qroup  that  gets  the  maximum  probabil- 
ity, providing  it  exceeds  the  given  default  threshold. 


On  step  2,  variable  26  (channel  3,  128  msec)  enters  with  an  F of  41.8, 
and  the  F level  for  variable  22  drops  from  125.7  to  96.5.  Overall  per- 
formance rises  from  57.3%  to  75%  on  the  testina  set  (Table  9).  Now  both 
red  and  yellow  epochs  are  being  correctly  classified  virtually  every  time. 


Steps  3,  4,  5 and  6 add  more  variables  from  channel  3.  (See  Tables  10,11 
12  and  13).  Performance  improves  to  94%  correct.  When,  on  step  7 (Table 
14)  a variable  from  channel  1,  120  msec  is  added,  the  F levels  of  the 
prior  variables  are  seen  to  drop;  the  largest  drop  occurs  in  variable  26, 
channel  3 at  128  msec,  demonstrating  a correlation  between  these  variables, 
larger  at  the  closest  latency.  The  classification  performance  at  step  7 
does  not  change  from  step  6. 


Step  8 (Table  15)  adds  another  variable  from  channel  3,  312  msec,  and 
the  performance  improves  to  95.8%.  At  the  ninth  step  (Table  16),  a vari- 
able from  channel  2 is  added,  and  performance  rises  to  97.9%  correctly 
classified  from  the  testing  set  and  99%  from  the  training  set,  a remark- 
able set  of  figures  indeed.  This  performance  is  not  improved  by  addinq 
the  tenth  variable  (Table  17),  and  the  eleventh  (Table  18).  Instead,  im- 
proving the  training  set  classification  accuracy  to  100%  results  in  a 
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sliqht  drop  of  the  testing  set  classification  performance  (to  95.8%), 
a sure  sign  that  the  last  improvement  was  idiosyncratic.  Further  steps 
add  no  more  to  the  performance,  step  20  giving  the  same  results  as  step 
11  (Table  19).  The  chi  square  values  for  the  tenth  step  testing  con- 
fusion matrix  give  a p <.001  that  such  results  could  be  obtained  by 
chance. 

It  was  concluded  tentatively  at  least,  that  no  more  than  ten  steps  should 
be  needed  for  highly  accurate  single  evoked  response  classification 
under  the  present  experimental  conditions,  a value  that  is  consistent 
with  evidence  from  other  quarters  (e.g.  previous  function  analysis 
studies). 

If  the  cost  of  an  error  is  higher  than  that  of  non-classification,  then 
those  epochs  which  do  not  have  a very  hiqh  probability  of  belonging  to 
one  of  the  source  groups  can  be  defaulted,  through  use  of  the  a posteriori 
decision  threshold  parameter.  For  instance,  when  this  parameter  is  set 
to  .999,  no  classification  errors  are  made  (Table  20)  for  subject  SB01 , 
but  the  price  for  100%  classification  accuracy  is  a 23%  default  rate. 

If  tie  training  set  is  taken  as  the  first  96  epochs,  and  the  testing  set 
the  next  96  epochs,  the  performance  drops  only  slightly,  to  95.8%  correct 
(Table  21).  Here  again,  100%  classification  accuracy  is  achieved  by  set- 
ting the  decision  threshold  to  .998  and  34%  of  the  epochs  are  then  defaulted 
(Table  22).  Subsequent  tests,  using  the  mutual  information  measure 
defined  in  Section  4,  indicated  that  an  optimal  trade-off  value  of  the 
thresho’d  parameter  was  to  be  found  between  .4  and  .6. 
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SHUx  MR13  75  FOUR  COLOR  VEP  EXPR. 


A POSTERIORI  DECISION  THRESHOLD  .999 


DISCRIMINANT  FUNCTIONS  AFTER  10  STEPS*  WITH  D.P.F.  = 3.0*  83.0 


EPOCHS  accepted  unconditionally. 


VAWTAfll  F 

F 

GROUP  NAMES 

INDEX 

NAME 

level 

RED-8 

YELLOW-6 

GREEN-3 

5 

1*120 

. 15454E 

02 

.45679E-01 

-.33304E-02 

.22496E-01 

17 

2*168 

•73413E 

01 

• 66230E-02 

- .25650E-01 

.11 358E -01 

22 

3*080 

.24293E 

02 

.69380E-01 

•71A85E-02 

. 44304E-02 

23 

3*088 

.90532E 

01 

-.  18008E-02 

- . 18565E-01 

• 12541E-01 

24 

3*096 

. 32040E 

02 

- . 14633E“03 

•29855E-01 

.24809E-01 

26 

3*  1.28_ 

•32252E  02 

-•19896E-01 

- • 363Q5E-0 1 

.20773E-01_ 

37 

3*  144 

.16365E 

02 

-.23907E-01 

- .53544E-02 

-.49949E-01 

28 

3*160 

.17234E 

02 

-.39759E-01 

• 22573E-01 

- * 12706E-01 

30 

3*312 

.99191E 

01 

» 44459E-01 

. 18699E-01 

.34996E-01 

94 

4*080 

.64437E 

01 

.28637E-01 

- • 48399E-02 

•29973E-02 

CONSTANT 

*» 39921E  02 

-.69731E  01 

- . 1 1689E  02 

BLUE^l 
• * 2P831E-01 
-•21997E-C1 
•87856E-02 
•23810E-01 
-•30282E-O1 
•18151E-01 
.'8A*1AE-02 
-•22959E-01 
• » 1 C486E-02 
- • 161  ‘k2E-02 
-'-75536E  01 


TRAINING  CONFUSION  MATRIX  IEPA  4 NEPI  * 96 


SOURCE 

PERCENT 

correct 

RED-8 

CLASSIFIED  as 
YELLOW-6  GREEN-3 

BLUE-1 

default 

RED-8 

loo.o 

21.0 

.0  .0 

• 0 

• 0 

yellow-6  ... 

1Q0.0 

.0 

19.0  ,.0_  ... 

. ..o__ 

6*0 

GREEN-3 

100.0 

.0 

.0  15.0 

»0 

10.0 

blue-1 

total 

100.0 

100.0 

.0 

.0  .0 

19.Q 

6.0 

TESTING  CONFUSION  MATRIX  IEPT  e 5 NEP!  « 96 


SOURCE 

PERCENT 

CLASSIFIED 

AS 

BLUE-1  _ 

DEFAULT 

CORRECT 

RED-8 

YELLOW-6 

GREEN-3 

RED-8 

100.0 

23.0 

.0 

.0 

• 0 

. 0 

YELL0w-6 

100.0 

.0 

20.0 

.0 

.0 

4 • 0 _ 

GREEN-3 

loo.o 

.0 

.0 

13.0 

• 0 

11.0 

blue-i 

loo.o 

.0 

.0 

.0 

1 8 . 0 

7.0 

total 

100.0 

completed^  10 

STEPS  OF 

ANALYSIS 

i 

TABLE  20 

7T- . 

,,  * . .....  ... 

* 


SBG i MR 13  4 COLOR  VEP  EXP.  FIRST  HALF  VS.  SECOND  HALF  . AP  25 * M,  BUCK 
DATA  SET  IDENTIFIERS:  EXPR  = 00^1 


NO.  OF  VARIABLES  = **0  WGT  • D»O.F.  = 

F LEVEL  TO  RFMOVE  = 2.200  POSTERIORI  THRESHOLD  = 

discriminant  Functions  aftfr  10  steps,  with  d.o.f.  = 

EPOCHS  ACCEPTED  UNCON'D  I T I ONALLV  . 


96*  CO 
.250 


3.0*  80.0 


VARIABLE 

F 

group  NAMES 

INDEX 

NAME 

LEVEL 

RED-8 

YELLOW-6 

GREEN-3 

BLLE-1 

3 

1*072 

. 10081E  02 

-.59918E-01 

-. 16802E-02 

.40974E-02 

-• 13594E-01 

4 

1*104 

•92262E  01 

• 33689E  “0  i. 

- • 21 239E-02 

-.13910E-01 

. 24566E-01 

5 

1*120 

. 1 5 2 4 2 E 02 

-.20966E-01 

• 76328E-03 

.45309E-02 

- .55C14E-01 

6 

1*123 

•94567E  01 

•90918E-01 

•15685E-01 

• 10962E-01 

•3276CE-01 

22 

3*080 

.20124E  02 

•94046E-01 

• 12470E-01 

. .16920E-01 

• 2 364  3E-01 

23_ 

3*088 

.56605E_01 

•16924E-01 

_ -.89115E-0? 

.16344E-01 

•19173E-01 

24 

3*096 

.87529E  01 

.55347E-02 

. 18783E-01 

• 96249E-02 

-.  197UE-01 

25 

3*120 

• 1 9753E  02 

-.33593E-01 

-•21081E-01 

-.78049E-02 

•23433E-01 

23 

3*160 

• 1 5540E  02 

-•53320E-01 

. 1 41 62E-02 

- . 25766E-01 

- •31667E-01 

40 

4*272 

.46445E  01 

-.  17030E-02 

•56732E-02 

-.  11727E-01 

-•14957E-01 

C 

5NSTANT 

- . 54822E  02 

-.39615E  01 

-.81830E  01 

- • 1 1918E  02 

TRAINING 

CONFUSION 

matrix 

IEPA  s 4 

NEPI  = 96 

--  — 

SOURCE 

PERCENT 

CLASSIFIED 

AS 

-■  — 



correct 

RED-8 

YELLOW-6 

GREEN-3 

BLUE-1 

DEFAULT 

RED-8 

ico.o 

18.0 

.0 

.0 

.0 

• 0 

J£&LL£tWi6. 

- JLQQiQ_ 

._*0 

24  »JD 

_ .0 

.0 

.0 

GREEN-3 

91.3 

.0 

2.0 

21.0 

• 0 

.0 

BLUE-1 

_ioo.o 

• 0 

.0 

.0 

31.0 

»0_ 

total 

97.9 

testing  CONFUSION  1 

MATRIX  IePT  = 97 

NEPI  = 

96 

SOURCE 

PERCENT 

CLASSIFIED 

AS 

CORRECT 

RED-8 

YELLOW-6 

green-3 

BLUE-1 

default 

RED-  * 

100.0 

24.0 

.0 

.0 

.0 

.0 

YELLOw-6 

96.0 

.0 

24.0 

1.0 

.0 

.0 

GREEN-3 

96.2 

.0 

.0 

25.0 

1.0 

.0 

blue-i  / 

90.5 

• 0 

.0 

2.0 

19.0 

.0 

TOTAL  7 

95.8 

completed 


steps  OF  analysis 


TABLE  21 


( Reproducedlrom  f0j 

1 best  available  copy. 

£3e:  MR13  4 COLOR  VEP  EXP.  FIRST  HALF  VS.  SECOND  HALF  . AP  35/  M . BUC< 

dvta  set  identifiers:  expr  = oc hi 

no.  t F VARIABLES  8 _JfO  WGT . D.O.F.  * 96*00 

r LEVEL  TO  REK8VE  3 2.200  PQSTL'RIORI  THRESHOLD  * .997 


DISCRIMINANT  FUNCTIONS  AFTER  10  STEPS,  WITH  D.O.F.  * 
EPOCHS  ACCEPTED  UNCONDITIONALLY. 


VA 

R I AbLE 

F 

GROUP  NAMES 

INDEX 

NAME 

. level..  . 

RED-8 

YELLOW, 6 

GREEN-3 

BLUE*! 

3 

1/072 

•10081E  02 

- • 5991 8E -0 1 

" • 16802E-02 

.40974E-C2 

-•13594E-01 

4 

1/  10^ 

.9L262E  01 

• 33689E-01 

-•21239E-02 

•• . 13910E-01 

•24566E-01 

5 

1/  120 

•15242E  02 

-•20966E-01 

•76328E-03 

•45309E-02 

-•55C14E-01 

6 

1/128 

• ?4567F  01 

.9C918E-01 

•15685E-0! 

. 10962E-01 

•32760E-01 

22 

3/080 

.20124E  02 

•94046E-01 

• 12470E-01 

• 16920E-01 

•23643E-01 

23 

3/088 

.56605E  01 

. 16924E-01 

• • 891 15E-02 

•16344E-01 

•19173E-01 

24 

3/096 

.87529E  01 

• 55347F-02 

• 18783E-01 

•96249E-02 

-•1971  IE-01 

25 

3/  120 

. 1 9753E  02 

-.33593E-01 

- • 2108  IE-01 

-.78049E-02 

•23433E-01 

28 

3/  160 

. 1 5540E  02 

-.58320E-01 

•14162E-02 

-.25766E-01 

-•31667E-01 

4 0 

4/272 

• 46445E  01 

-•17030E-02 

•56732E-02 

* • 1 1727E-01 

-•14957E-01 

CONSTANT 

- . 54822E  02 

- • 396 1 5E  01 

- • 8 1830E  01 

- - 1 1 9 1 8E  02 

training 

CONFUSION 

MATRIX 

IEPA  * 4 

NEPI  3 96 

SOURCE 

PERCENT 

CORRECT 

RED-8 

CLASSIFIED  as 
YELLOW- 6 GREEN-3 

BLUE-1 

DEFAULT 

RED-8 

loo.o 

18.0 

.0 

.0 

.0 

• 0 

YELLOW-6 

loo.o 

.0 

14.0 

.0 

.0 

10.0 

GREEN~3 

loo.o 

.0 

.0 

13.0 

.0 

10,0 

. 

BLUE-1 

TOTAL 

loo.o 

loo.o 

.0 

.0 

.0 

25.0 

6.0 

TESTING  CONFUSION  MATRIX  IpPT  * 97  NEPI  > 96 


SOURCE 

PED-8 

PERCENT 

CORRECT 

loo.o 

RED-8 

24.0 

classified 

YELLOW-6 

AS 

GREEN-3 

BLUE-1 

DEFAULT 

. 0 

• 0 

• 0 

• 0 

ELL5W-6 

100*0 

.0 

12.0 

.0 

• 0 

13.0 

GREEN-3 

100.0 

.0 

.0 

1 1.0 

.0 

15.0 

— 

blue-!7 

total 

100.0 

loo.o 

.0 

.0 

.0 

16.0 

5.0 

• 

COMPLETED  10  STEPS  0F  ANALYSIS 


TABLE  22 
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3 . 2 Pattern  Position  Fxner1ments 
Purpose 


The  color  stimuli  used  in  the  first  experiment  were  always  selected  by 
the  computer.  The  pattern-position  experiment  was  designed  to  allow 
stimulus  selection  either  by  computer,  for  a training  series,  or  by  the 
subject,  for  use  in  controlling  a separate  "application  program" 
once  the  computer  has  established  a set  of  discriminant  functions  using 
BCI/SDA. 

Methods 

The  methods  of  EEG  data  collection  are  identical  to  those  described  in 
the  color  Experiment.  The  only  difference  is  in  the  stimulus  arrangement. 
A brief  flash  trans-il luminates  a checkerboard  pattern,  i 3/4"  square, 
at  a pupil/display  plane  distance  of  46",  thus  subtencing  a 2.2°  visual 
angle.  The  individual  checks  subtended  a 12'  visual  angle.  Four  solid 
state  diode  lamps  (LED's)  are  positioned  at  the  top,  bottom,  left  and 
right  edges  of  the  checkerboard,  1 cm  in  front  of  the  checkerboard.  The 
checksize,  and  checkerboard  size  were  chosen  following  C.T.  White  (1968) 
in  order  to  produce  large  evoked  responses  at  the  scalp.  A red  filter 
was  used  behind  the  checkerboard  to  benefit  from  the  previously  observed 
better  consistency  of  red  responses,  and  a blue-green  background  was 
continually  on,  to  further  enhance  retinal  red  response;  the  background 
was  superimposed  on  a large  area  over  the  checkerboard.  The  implementa- 
tion of  the  present  experiment  is  open  loop.  For  each  run,  200  epochs 
are  taken,  with  the  computer  randomly  selecting  one  of  the  four  fixation 
lights  for  presentation  on  each  trial.  The  subject  is  instructed  to  fix- 
ate steadily  on  the  light  selected  until  one  second  after  the  flash.  Thus 
the  proximal  stimulus  occupies  one  of  four  partly  overlapping  retinal 
positions  on  each  trial. 
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Analysis 


The  data  were  analyzed  by  stepwise  discriminant  analysis  exactly  as  in 
the  Color  Experiment.  One  half  of  the  epochs  were  taken  for  a training 
set,  and  the  other  100  epochs  were  then  classified  using  the  DF  obtained 
on  the  traininq  set.  A general  four  channel,  16  msec  interval  variable 
selection  paradigm  was  again  used. 

Results 


As  in  the  Color  Experiment,  evaluation  of  performance  is  based  on  the 
percent  of  correct  classification  of  epochs  from  the  testinq  set,  with 
no  defaults. 


Subject-Date 

EXPR 

Performance 

NLM1 -AP08-75 

CB41 

74% 

MHDI  API  5-75 

CB41 

63% 

ATW1  API  7-75 

CB41 

86% 

(Detailed  results  from  subject  ATW  are  shown  in  Table  23) 


Table  24  shows  the  performance  obtained  when  the  a posteriori  decision 
threshold  is  raised  to  .900.  A classification  accuracy  of  92%  is 
achieved,  with  25*  defaults.  This  performance,  while  not  yet  equal  to 
that  obtained  for  color  stimuli,  is  quite  good,  and  can  doubtlessly  be 
substantially  improved. 

Discussion 


Reqan  (1973)  has  speculated  that  the  use  of  larqe  (14°  diameter)  stimuli, 
rather  than  foveal  stimuli,  would  produce  less  intersubject  variation  in 
evoked  responses  obtained  from  stimuli  of  varying  retinal  position.  There- 
fore, it  is  intended  to  repeat  the  Pattern  Position  Exoeriment  with  a 
larger  checkerboard,  in  order  to  find  the  most  efficient  stimulus  for  the 
purpose  of  on-line  evoked  response  classification.  Other  improvements 
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of  the  tarqet  are  possible,  in  particular  the  use  of  a diamond  shape 
which  will  eliminate  retinal  overlap  between  positions.  It  is  also 
expected  that  the  orthogonal  transformation  of  the  multi-channel  data, 
which  did  not  perform  well  with  color,  should  be  of  advantaqe  in  this 
series  because  of  the  spatial  dependence.  Finally  this  procedure  is 
about  to  be  performed  on-line  using  a graphic  program  to  provide  sub- 
ject feedback.  Spectacular  improvement  in  reliability  is  expected  in 
this  case  because  of  the  operant  conditioning  inherent  to  the  procedure. 
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4.  THEORETICAL  CONSIDERATIONS 


4.1  Stepwise  Discrimination  and  the  Decision  Rule 

Consider  the  discrimination  of  a trainlnq  set  consisting  of  M epochs, 
represented  by  N time  samples.  The  initial  data  set  thus  consists  of 
M N-vectors: 

X = i Xyn  v = { ms  I,  I...F1  ; nzljl...N 

Where  j = (1,2...J)  is  an  index  that  designates  the  trainlnq  qroups. 

There  are  J such  qroups  (the  "input  alphabet")  in  the  training  set; 

Mj  is  the  number  of  epochs  in  group  j and  obviously; 

E ^ = * 

J 

The  mean  for  qroups  i and  j will  be  represented  by  the  vectors; 

(n  can  be  replaced  by  k) 

The  classification  is  conducted  in  two  sections.  First  a step-wise  dis- 
criminant procedure  selects  K samples,  from  the  original  N,  that  have 
optimal  discrimination  properties.  There  is  no  loss  of  generalities  in 
placinq  these  samples  at  the  beqlnnlnq; 

* - 1 \ 

with  m = 1.2...K.  The  traininq  set  is  thus  now  reduced  to  M K-vectors; 

Second,  a discriminant  function  o(X)  is  obtained  for  each  qroup.  The 
function  is  a measure  of  the  posteriori  probability  p(j|xj  that  a given 
epoch  Xm  belong  to  group  j qiven  X . Thus  if 

9j(\n)  > 
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for  all  i/j  ; then  this  epoch  would  have  to  be  ed  in  qroup  j 

accordinq  to  the  posteriori  probabilities.  Discrmt  it  functions  are 

actually  obtained  from  the  traininq  set,  which  ii  stead,  provides  the 

probability  p(X  ,j)  of  occurrence  of  a qiven  observed  epoch  X which 
m m 

is  known  to  belonq  to  qroup  j;  then1 

1'  (X'm  = F C*M  j J i ) (1 ) 

Specifically  a loqarithmlc  form  is  calculated  which  leads  to  different 
numerical  values  for  the  function  q but  has  the  same  properties: 


qj  (Xm^  = 1oq  P ( » J ) + 1oP  p( J ) 


(2) 


which,  assumi  iq  normal  distributions  with  different  means  but  equal 
varianc  e (for  each  qroup)  takes  the  form: 


ID ?7X..  " 
2 J 1 


) + 


Urj  f><j) 


2 

D is  the  squared  Mahalanobis  distance.  For  an  epoch  y This 
distance  to  the  mean  for  qroup  j is  qiven  by; 


if  I / = (M- 1)  I L K k-  i' ) 


n%  f< 


"U  . \ l K ; ^ - M ...  k 


(3) 


nk 


is  derived  from  the  original  within  qroup  cross-product  matrix; 


Vl,  W2i. 


(4) 


W is  first  partitioned;  the  contributions  of  the  K selected  first 
samples  are  vested  in  W-|  1 ; and  is  inverted  yielding ; 


(3) 
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with  n,k  = 1 ,2. . .K 


A confusion  matrix  can  then  be  established  that  shows  the  number 
of  epochs  M..  that  came  from  group  j and  whose  posterior  probability 
was  larqer  for  group  i. 

In  the  testing  phase  the  discriminant  functions  9j(x)  are  evaluated 
for  j = 1.2...J,  on-line,  in  real-time  for  each  incoming  epoch  x 
and  classified  accordingly.  The  posteriori  probabilities  of  belonglnq 
to  each  group  are  also  calculated; 

. Ni)E*pj>kx)l 

1,0 |X>  <6> 

in 


-44- 


i. 


T 


4.2  The  Mutual  Information  Transfer 


Let  A = be  the  input  alphabet  (e.g.  the  set  of  color 

labels  for  the  stimulus  flashes).  The  a-priori  entropy  of  the  alpha- 
bet is  given  by: 


J 


j = J 


( 7 1 


Let  B = (br..bj,bj+1)  be  the  output  alphabet  (e.g.  the  set  of  classes 
established  by  a corresponding  set  of  decision  functions  over  the  EEG 
measures  (the  recorded  evoked  responses).  The  decision  functions  map 
A into  B,  where  b.  corresponds  to  a.  for  each  j=1..J  and  where  bT  . 
represents  an  additional  default  class. 


Next^one  def i nes : 


( 8 ) 


as  the  a posteriori  entrcDy  of  the  input  alphabet  given  the  event  b.. 
The  sum  over  all  b's  gives  the  "eguivocation"  of  A with  B: 


( 9 ) 


H (A I B ) = 0 for  a completely  deterministic  mapping  (A-»B);  reciprocally 

H ( A I B ) = H(A)  if  the  mapping  is  completely  random,  i.e.  is  B is  indep- 
endent of  A. 


From  there  the  mutual  information  I(A,B)  between  the  two  alphabets  or 
sets  of  events  is  defined  as: 

I (A,B?  = H(A)-H^lB) 

I is  non-negative  and  varies  between  zero  (independence)  and  H(A). 
H(A)  has  an  upper  bound,  which  therefore,  also  holds  for  I(A,3); 
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J = - 7 


max  H(A)  = log^N  bits 


reached  when; 


(10  ) 


Thus,  the  mutual  information  provides  a single  number  that  character- 
izes the  performance  of  the  channel  (i.e.  of  the  experimental  paradiqm) 
that  can  be  directly  compared  to  the  number  of  bits  embodied  in  the  in- 
put channel  (i.e.  H(A)  = 2 for  a four  color  experiment). 


It  can  be  shown  that  mutual  information  is  reciprocal  I(A,B)  = I(B,A). 
I(A,B)  can  also  be  expressed  in  terms  of  the  conditional  mutual  Infor- 
mation I(a..,B)  defined  for  each  a.  such  that; 

%;  J 

I(ft,6)  _ z.  p(*j ) T =>^8)  (n  ) 

with 

f f>(b;l5;)  1 

j J B1  - | |f" 

j 

This  expression  is  practical  because  it  can  be  estimated  directly  (row 
by  row)  since  p ( b ^ | a j ) figures  in  the  confusion  matrix  generated  by 
each  experiment. 

The  conditional  estimate  I(aj,B)  calculated  for  each  row  from  (12  ) 
measures  separately  the  capability  of  each  input  condition  or  class  to 
qet  through  the  channel.  Since  p(a^)  may  not  be  the  same  for  all  j, 

s) 

the  upper  bound  H(A)  .valid  for  I(A,B)  does  not  hold  for  its  components 
I ( a . , B ) ; rather; 

J 

ft)  = (13) 

Mutual  information  calculations  are  now  incorporated  in  the  BCI  Step- 
wise Discriminant  Analysis  program. 
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Between  A 


Comparison  Between  Average  Evoked  Responses  (AElt)  and  Discriminant  Function  Coefficients  (DFC) 


GREEN 


Comparison  Between  Average  Evoked  Responses  (AER)  end  Disc-  rim  inant  Function  Coefficients  (D  PC) 


5.  FACILITIES 


The  project  continues  to  be  conducted  under  the  auspices  of  the  Computer 
Science  Department,  University  of  California,  Los  Angeles,  The  principal 
facility  for  this  project  is  the  computer  system  at  the  Brain  Computer 
Interface  Laboratory.  Laboratory  equipment  includes  three  dedicated  com- 
puters (XDS  930,  XDS  920  and  IMLAC  PDS-1)  with  complete  peripherals  (card 
readers,  card  punch,  rapid  access  drum,  tape  drives  and  line  printer). 

Experiment  subjects  are  monitored  from  a specially  designed  shielded  en- 
closure that  contains  various  input  devices  and  output  displays  desiqned 
in  a modular  fashion  for  ease  of  interfacing  with  the  digital  system. 

The  experiment  is  conducted  from  an  adjacent  room  containing  the  control 
terminals  to  the  system  computers,  the  recordinq  equipment  for  EEG  and 
other  biosignals,  as  well  as  voice  and  video  communication  devices. 

The  amplified  EEG  siqnals  are  routed  to  a digitizing  station  capable 
of  handlinq  50  simultaneous  channels  of  analog  input.  During  experi- 
ments, a dedicated  XDS  930  computer  with  16K  words  of  core  memory  and 
2M  characters  on  magnetic  drum  acts  as  data  input  controller  and  real- 
time experiment  controller.  All  real-time  processing  functions  are  per- 
formed by  the  930  which  also  creates  complete  experiment  records  for  off- 
line batch  processing.  These  contain,  for  each  data  "epoch",  the  experi- 
ment parameters  (sampling  rate,  epoch  lengths,  etc.)  specified  by  the 
experimenter  as  well  as  selected  results  of  on-line  computation,  suLject 
responses,  etc.  The  930  also  controls  an  IMLAC  PDS-1  minicomputer  and 
display  terminal  with  8K  of  memory  which  is  reserved  for  the  generation 
of  visual  feedback  display  and  some  other  functions.  In  addition,  the 
PDS-1  as  a stand-alone  computer  can  perform  extensive  calculations  and 
generate  sophisticated  qraphics  including  animation. 

For  very  laroe  data  processing  programs,  the  main  computing  power  is 
provided  by  the  campus  IBM  360/91  (Campus  Computing  Network)  which  is 
eguipped  with  an  exceptionally  large  core  memory  of  4M  bytes.  The  digit- 
ized data  reaches  the  IBM  360/91  from  the  laboratory  by  a special  high 
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speed  data  line  that  is  used  to  write  and  read  directly  into  and  from 
the  360/91  core.  The  data  transfer  is  controlled  with  a separate  pro- 
cessor (XDS  920)  to  allow  buffering  and  transfer  without  interference 
with  experiments.  A monitor  program  in  the  360/91  controls  both  the 
data  flow  and  the  processing  protocol  from  a privileged  position  with 
respect  to  the  360/91  operating  system  software,  thus  insuring  immedi- 
ate execution.  Complex  proqrams  such  as  spectral  or  functional  analysis 
of  the  signals  can  be  performed  and  the  results  fed  back  to  the  labora- 
tory with  minimum  turn-around  time.  The  "awakening"  of  this  software 
system  and  all  subsequent  file  handling  are  placed  under  the  campus  time- 
shared  system  (URSA)  and  controlled  by  an  IBM  3277  terminal  in  the  lab- 
oratory. 

Finally,  the  BCI  laboratory  computer  system  has  wired-in  direct  access 
to  the  ARPA  Network.  The  Network  is  being  used  for  accessing  and  trans- 
mitting data  to  distant  facilities  (such  as  MIT-MULTICS)  and  for  commun- 
ication with  other  Biocybernetic  research  groups. 


